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PREFACE 


This  Memorandum  is  part  of  a  continuing  research  effort  by  the 
RAND  Cost  Analysis  Depai tment  to  improve  its  capability  for  estimating 
costs  of  future  weapon  systems.  One  unavoidable  problem  in  the  prep¬ 
aration  of  such  estimates  is  the  uncertainty  about  something  which 
will  O’dy  come  into  being  at  a  future  time.  We  are  often  uncertain 
as  to  the  exact  nature  of  the  system,  of  its  methods  of  operation, 
and  also  uncertain  about  the  military  and  political  universe  in  which 
it  will  function.  None  of  the  methods  currently  available  for  dealing 
with  this  problem  are  entirely  satisfactory.  The  work  described  in 
this  Memorandum  is  not  presented  as  the  final  solution  either;  but  it  is, 

rather,  offered  as  a  meaningful  and  useful  technique  for  handling  a 
* 

portion  of  the  total  problem. 
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SUMMARY 


Suggested  in  this  Memorandum  is  a  technique  for  expressing  cost 
estimates  of  future  systems  as  probability  distributions  to  reflect 
the  uncertainty  of  the  estimate.  The  impact  of  this  information  is 
shown  to  be  relevant  to  the  decision-making  process. 

For  the  purpose  of  this  study,  the  relationship  between  the  sources 
of  uncertainty  and  system  cost  estimates  is  depicted  as  an  input-output 
model.  Within  this  framework,  a  procedure  was  developed  to  estimate 
probability  distributions  for  each  of  the  input  uncertainties.  From 
the  input  distributions,  a  Monte  Carlo  procedure  is  used  to  generate 
a  series  of  system  cost  estliaates.  A  frequency  distribution  and  com¬ 
mon  statistical  measures  are  then  prepared  from  the  set  of  output 
estimates  to  ascertain  the  nature  and  magnitude  of  the  system  cost 
uncertainty. 

To  illustrate  the  proposed  technique,  a  case  study  involving  the 
cost  estimate  of  a  hypothetical  aircraft  system  with  air-to-surface 
missiles  is  presented. 
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I.  INTRODUCTION 


A  primary  function  of  the  long-range  planning  process  is  to 
examine,  in  a  systematic  manner,  future  courses  of  action  in  order  to 
identify  alternatives  which  seem  preferable  to  others.  The  analytic 
techniques  used  for  such  studies  are  known  as  cost/effectiveness 
analysis  or  systems  analysis.  As  part  of  the  total  analytic  process, 
cost  analysis  deals  with  the  problem  of  determining  the  resource 
impacts  of  the  alternative  proposals. 

It  is  an  inescapable  fact  that  estimates  of  resource  requirements 
for  future  systems  are  beset  with  uncertainty.  The  question  is  not 
whether  uncertainty  exists,  but  rather  in  determining  the  magnitude 
and  nature  of  the  uncertainty.  Before  addressing  this  problem,  we 
should  take  time  to  examine  the  sources  of  resource  (cost)  uncertainty. 

SOURCES  OF  UNCERTAINTY 

Uncertainties  in  estimates  of  resource  requirements  for  future 

systems  arise  from  many  sources.  For  our  purpope  it  is  convenient 

to  consider  two  categories  of  uncertainty:  renuirements  uncertainty 

★ 

and  cost-estimating  uncertainty. 

Requirements  uncertainty  refers  to  variations  in  cost  estimates 
stemming  from  changes  in  the  configuration  of  the  system  being  costed. 
Here  system  configuration  change  means  deviations  from  original 
specifications  or  assumptions  regarding  hardware  characteristics  and/or 
system  operational  concepts.  Although  each  of  these  sources  of  un¬ 
certainty  i3  of  a  type  over  which  decision-makers  have  control,  studies 
have  shown  that  uncertainty  about  requirements  comprises  '  0  to  80  per 
cent  of  the  total  estimate  uncertainty. 

Cost-estimating  uncertainty  refers  to  variations  in  cost  estimates 
of  a  system  or  force  when  the  configuration  of  the  system  or  force 
remains  constant.  It  differs  from  requirements  uncertainty  in  that 
decision-makers  cannot  2ffect  the  magnitude  of  the  variations. 

G.  H.  Fisher,  A  Discussion  of  Uncertainly  in  Cost  Analysis.  Tl.e 
RAND  Corporation,  RM- 3071 -PR,  April  1962. 


-2- 


Cost-ebcimating  uncertainty  arises  from  numerous  sources:  dif¬ 
ferences  between  individual  cost  analysts.,  errors  in  the  data  base 
used  in  cost  analysis,  errors  in  cost  estimating  relationships,  extrap¬ 
olation  errors,  and  so  forth.  Although  we  shall  treat  both  categories 
of  uncertainty  in  this  Memorandum,  cost-estimating  uncertainty  is  more 
amenable  to  the  discussion  and  techniques  which  are  presented. 

RELEVAKCE  TO  DECISION-MAKING 

It  is  under  conditions  of  uncertainty  that  decision-makers  must 
evaluate  and  select  among  alternative  proposals  for  future  courses  of 
action.  With  explicit  information  describing  the  uncertainty  of  each 
system  cost,  decision-makers  will  be  aided  in  two  ways.  First,  the 
extent  and  probability  that  the  ultimate  system  cost  could  differ  from 
its  expected,  single-valued  estimate  can  be  anticipated  and  evaluated. 
With  a  quantitative  measure  for  the  precision  of  cost  estimates, 
decision-makers  should  be  better  able  to  judge- -according  to  their 
preferences  and  attitudes  toward  risk — the  desirability  of  each  system 
alternative.  The  second  benefit  is  that  decision-makers  with  this 
information  will  be  more  apt  to  choose  the  preferable  alternative, 
especially  in  cases  where  the  expected  coats  for  competing  systems 
are  nearly  coincident  but  have  differing  uncertainties .  To  Illustrate 
this  last  point,  consider  the  following  example. 

Suppose  two  systems,  A  and  B,  are  to  be  compared  using  cost 
(resource  requirements)  as  the  criterion  for  evaluation.  Figure  1 
shows  four  cases  in  which  cost  estimates  ate  exp^ssed  as  probability 
distributions  to  reflect  the  actual,  though  perhaps  unmeasurable, 
uncertainty  surrounding  each  estimate.  In  Case  I,  the  decision-maker 
is  faced  with  no  problem  since  all  possible  costs  for  System  A  are 
lover  than  System  B.  Using  single-valued  estimates  (the  mean  or  ex¬ 
pected  value)  would  not  affect  the  decision.  The  situation  in  Case  II 
is  slightly  different  in  that  there  is  some  probability  that  the  actual 
cost  of  System  A  will  be  higher  than  System  B.  If  this  probability 
is  not  large,  the  decision-maker  would  still  select  System  A.  However, 
when  the  overlap  is  significant,  the  single-valued  estimates  would  no 
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longer  provii.  valid  criterion  for  system  selection.  In  the  third 
ca.-se,  both  single-valued  estimates  are  the  same,  but  the  cost  distri¬ 
bution  for  System  B  has  a  larger  range.  Here  the  decision-maker’s 
disposition  toward  uncertciinty  and  risk  must  dominate  the  selection 
process.  If  ne  prefers  to  minic;ize  risk,  he  will  select  System  A. 
However,  if  the  decision-maker  is  willing  to  risk  possible  high  costs 
for  the  chance  tc  obtain  a  low-cost  system,  he  might  prefer  System  E. 
Case  IV  illustrates  a  more  complicated  situation  where  the  expected 
cost  of  S;  5tem  B  is  lower  but  much  less  certain  than  System  A.  If 
the  decision-maker  us;  c  or'  ,  single-valued  estimates  in  this  case, 
he  would  most  i  • kely  choose  the  less  desirable  alternative. 

We  should  conclude  from  the  previous  example  that  cost  uncertainty 
can  be  relevant  to  the  decision-making  process  and  an  estimate  of 
its  nature  and  magnitude  would  be  a  valuable  addition  to  cost/effective 
ness  studies.  Given  the  context  of  the  uncertainty  problem,  let  us 
consider  some  alternative  approaches  which  might  be  used  for  expressing 
cost  uncertainty. 

EXPRESS  'JG  COST  UNCERTAINTY 

common  procedure  for  describing  uncertainty  of  system  cost  is 
t.  )  test  its  sensitivity  against  system  cost  inputs  when  they  are 
varied  over  their  relevant  ranges.  Sensitivity  analyses  of  this  type 
help  to  identify  major  sources  of  uncertainty  and  provide  valuable 
information  to  the  system  designer.  Such  a  procedure  does  little, 
however,  to  reveal  the  extent  to  which  the  estimated  system  cost 
might  differ  from  th^  actual  cost. 

Another  approach  which  has  been  used  to  express  cost  uncertainty 
requires  the  analyst  to  specify  the  lowest  and  highest  possible  values 
for  each  system  cost  input  in  addition  to  its  most-likely  value. 

From  the  three  sets  of  input  values  are  derived  separate  system  cost 
estimates.  The  most-likely  values  establish  the  central  tendency  of 
the  system  cost,  while  the  other  two  are  used  to  determine  a  range 
for  the  cost  estimate.  Although  this  approach  has  considerable  merit, 
it  tends  to  greatly  exaggerate  the  uncertainty  of  system  cost  estimates 


since  it  is  extremely  unlikely  that  all  system  cost  inputs  will  be 
at  the  lowest  (or  highest)  values  at  the  same  time. 

The  technique  presented  in  this  Memorandum  suggests  a  scheme 
whereby  resource  estimates  can  be  expressed  as  a  probability  distribu¬ 
tion  around  a  mean  value.  This  permits  the  cost  analyst  to  express  in 
a  quantitative  manner  the  uncertainty  of  his  estimate.  In  the  sections 
to  follow,  we  shall  examine  the  proposed  technique  for  estimating  cost 
uncertainty,  present  a  case  study  to  illustrate  the  salient  features 
of  the  technique,  and  finally  discuss  possible  application  of  these 
ideas  to  the  bigger  problem  of  treating  uncertainty  in  cost/ef fectiveness 
studies. 


II.  MONTE  CARLO  TECHNIQUES  FOR  ESTIMATING  UNCERTAINTY 


In  the  previous  section,  it  was  noted  that  cost  estimate  uncer¬ 
tainty  results  from  two  primary  sources--requirements  and  cost-estimating 
uncertainty.  The  relationship  between  the  system  cost  uncertainty 
and  its  sources  can  be  depicted  using  a  simple  input-output  model  • 
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Output  uncertainty 
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pig, 2 — Relation  of  system  cost  uncei  .^inty  to  source  uncertainty 

The  cost  analysis  model  portrayed  in  the  diagram  embodies  all 
cost  estimating  procedures  and  methodology  necessary  for  estimating 
the  system  cost.  For  our  purpose,  the  cost  factors,  constants,  and 
estimating  relationship  coefficients  relevant  to  the  system  being 
costed  are  treated  as  a  set  of  inputs  to  the  cost  model.  Associated 
with  each  cost  input  is  a  probability  distribution  to  reflect  its 
uncertainty.  In  Section  III,  it  will  be  shown  that  these  distributions 
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can  be  described  either  statistically  or  from  subjective  probabilities. 
The  second  input  set  defines  the  specifications  and  requirements,  along 
with  accompanying  uncertainties,  of  the  system  being  costed. 

As  it  now  stands,  the  problem  statement  is  to  estimate  the  un¬ 
certainty  of  the  total  system  cost  when  all  input  uncertainties,  subject 
to  the  complex  interactions  of  the  cost  analysis  model,  are  considered 
simultaneously.  The  proposed  solution  described  on  the  following 
pages  uses  a  simulation  technique  to  generate  the  input  parameters, 
then  prepares  a  series  of  system  cost  estimates.  From  the  set  of 
output  estimates,  common  statistical  measures  (mean,  standard  deviation, 
range),  and  a  frequency  distribution  are  calculated.  Let  us  first 
examine  the  techniques  for  simulating  input  uncertainty. 

SIMULATING  PROBABILITY  DISTRIBUTIONS 

At  this  point,  assume  that  a  cost  analyst  or  system  planner  can 
describe  each  input  parameter  with  a  probability  distribution.  This 
distribution  is  then  treated  as  a  theoretical  population  from  which 
random  samples  are  obtained.  The  methods  of  taking  such  samples,  as 
well  as  problems  which  rely  on  these  sampling  techniques,  are  often 
referred  to  as  Monte  Carlo  Methods. 

To  illustrate  the  Monte  Carlo  procedure  for  simulating  cost  input 
uncertainty,  consider  the  example  depicted  in  Fig.  3. 


Fig. 3  —  Monte  Carlo  sampling 
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'  From  the  probability  density,  Y  =  f(x),  describing  the  actual  (or 

estimated)  input  uncertainty,  a  cumulative  distribution  is  plotted. 

Next,  a  random  decimal  between  zero  and  one  is  selected  from  a  table 

‘\ 

of  random  digits.  By  projecting  horizontally  from  the  point  on  the 
Y-axis  corresponding  to  the  random  decimal  to  the  cumulative  curve, 
we  find  the  value  of  s:  corresponding  to  the  point  of  intersection. 

This  value  is  taken  as  a  sample  value  of  x. 

The  result,  if  this  procedure  is  repeated  numerous  times,  is  a 
sample  of  input  values  that  approximates  the  required  input  uncertainty. 
As  seen  in  Fig.  4,  the  more  repetitions,  the  better  the  simulated 
input  distribution. 


Sample  size  -  100 


fiample  size  -  500 


Sample  size  -  1000 


Fig, 4 — Simulated  input  distribution 


In  the  next  section  where  the  problem  of  estimating  system  cost 
(output)  uncertainty  is  treated,  each  of  the  input  parameters  must  be 
generated  using  the  Monte  Carlo  technique  just  described. 

ESTIMATING  f/YSTEM  COST  UNCERTAINTY 

The  procedure  for  estimating  system  cost  uncertainty  follows 
readily  once  simulated  Input  values  have  been  made.  To  illustrate 
the  methodology,  consider  the  following  simple  costing  model: 


where  C  *  Total  training  cost  (dollars) 

M  ■*  Manpower  requirements  (number  personnel) 

T  =  Initial  training  cost  (dollars/man) 

Suppose  the  actual  uncertainty  of  the  input  parameters  can  be  repre¬ 
sented  with  probability  distributions  as  shown  below,  with  L,  M,  and 
H  denoting  the  lowest  possible,  most-likely,  and  highest  possible 
values,  respectively. 


Manpower  requirement  Initial  training  cost 


L  M  H  L  M  H 


Fig. 5 — Input  uncertainty  distributions 

Furthermore,  assume  that  these  values  are  as  follows: 

_L _  M  H 

Manpower  requirement  75  100  125 

Initial  training  cost  3000  4000  7000 

From  the  input  distributions,  a  sample  value  for  both  the  manpower 
requirement  and  the  initial  training  cost  is  generated  by  means  of 
the  Monte  Carlo  technique.  Using  these  two  sample  values,  a  total 
training  cost  is  calculated.  The  procedure  is  repeated  again  and 
again  until  the  nature  of  the  output  uncertainty  has  been  established. 
Table  1  summarizes  the  procedure  for  1000  iterations. 


Table  1 


MONTE  CARLO  SIMULATION  OF  COST  UNCERTAINTY 


Iteration  M  x  T  =  C 


1 

83 

4,052 

336,316 

2 

108 

6,326 

683,208 

3 

103 

3,741 

385,323 

4 

101 

4,520 

456,520 

5 

0 

92 

3,874 

356,408 

0 

0 

ft 

1,000 

0 

0 

• 

0 

• 

Mean  Values 

100 

4,498 

450,000* 

Rounded  to  nearest  thousand. 


Fig. 6— Total  training  cost 
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From  the  set  of  cost  estimates  a  frequency  distribution  as  shown 
in  Fig.  6  can  be  prepared  to  portray  the  cost  uncertainty.  It  is 
interesting  to  note  that  the  mean  value  of  the  total  training  cost  is 
higher  than  the  traditional,  single-value  cost  estimate  ($400,000) 
the  product  of  the  most- likely  values  for  each  input' factor.  The 
difference  between  the  two  estimates  occurs  because  the  initial  train¬ 
ing  cost  uncertainty  is  skewed  to  the  right.  If  the  uncertainty  dis¬ 
tributions  of  both  input  factors  were  symmetric,  the  two  cost  estimates 
would  be  identical.  Of  course,  the  single- value  estimate  would  not 
describe  the  nature  or  magnitude  of  the  output  cost  uncertainty. 

Although  this  example  depicts  a  very  simple  costing  problem,  the 
techniques  which  were  used  to  estimate  cost  uncertainty  are  applicable 
to  more  realistic  situations.  However,  when  the  scope  of  the  cost 
analysis  problem  is  expanded  --  as  the  case  study  presented  in  Section 
III  --  it  is  expedient  that  the  costing  model  be  programmed  for  a  com¬ 
puter. 

It  must  be  noted  that  using  the  Monte  Carlo  technique  to  estimate 
cost  uncertainty  in  this  manner  requires  that  all  input  parameters 
be  mutually  independent.  For  instance,  in  the  example  described  above 
it  was  assumed  that  the  manpower  requirement  would  not  be  affected 
by  the  cost  of  training.  Although  there  are  times  when  these  assump¬ 
tions  might  not  be  true,  they  should  be  valid  for  situations  where 
the  inputs  have  less  than  order-of-magnitude  uncertainty.  With  cost 
factor  inputs,  we  can  probably  conclude  that  the  assumption  of  inde¬ 
pendence  is  true.  However,  with  system  requirements  we  must  be  more 
careful.  In  cases  where  a  functional  relationship  does  exist  between 
two  or  more  inputs,  we  can  often  circumvent  the  interdependence  problem 
by  incorporating  the  relationship  w'thin  the  cost  model;  or  if  the 

problem  demands,  one  could  explore  more  sophisticated  techniques  for 

★ 

sampling  from  joint  frequency  distribution. 

D.  J*  Finney,  "Frequency  Distribution  of  Deviation  from  Means 
and  Regression  Lines  in  Samples  from  a  Multi-variate  Normal  Population," 
The  Annala  of  Mathematical  Statistics.  Vol.  17,  1946. 
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III.  CASE  STUDY:  INDIVIDUAL  WEAPON  SYSTEM  COST  ANALYSIS 

For  the  purpose  of  illustrating  the  concepts  and  techniques 
presented  in  the  previous  section,  a  computerized  weapon  system 
costing  model  used  by  the  RAND  Cost  Analysis  Department  was  found  to 
be  quite  suitable.  The  model  is  used  to  determine  resource  require¬ 
ments  for  individual  weapon  systems  consisting  of  either  aircraft, 
aircraft  with  air-to-surface  missiles  (ASMs),  or  strategic  missiles 

(for  personnel  requirements  only).  A  complete  description  of  the 

•k 

operation  and  design  of  the  model  is  available  elsewhere. 

The  c sue  study  presented  in  this  section  is  a  hypothetical  air¬ 
craft  system  with  ASMs.  To  estimate  the  cost  of  this  system,  the 
computer  model  requires  195  inputs  (27  system  requirements  and  168 
cost  factors).  For  all  practical  purposes,  the  inputs  are  mutually 
independent.  The  uncertainty  of  the  system  cost  estimate  was  examined 
for  two  cases:  one  treating  only  cost -estimating  uncertainty,  the 
other  the  total  uncertainty. 

Up  to  this  point,  it  was  assumed  that  all  input  uncertainty  could 
be  described  with  probability  distributions.  Before  proceeding  further 
with  the  case  study,  we  must  deal  with  this  assumption. 

INPUT  PROBABILITY  DISTRIBUTIONS 

Distributions  expressing  input  uncertainty  can  be  derived  from 
either  statistical  parameters  or  subjective,  probabilities.  When  Input 
factors  are  based  on  historical  data,  the  first  approach  is  appropriate. 
Here  the  standard  error  of  estimate  for  the  factor  or  estimating  re¬ 
lationship  defines  the  magnitude  of  the  input  uncertainty.  For  example, 
95  per  cent  confidence  limits  can  be  used  to  estimate  the  extreme 
values.  Decisions  regarding  the  symmetry  of  the  uncertainty  should 
reflect  the  analytic  procedure  used  in  developing  the  factor  and  the 
nature  of  the  historical  data.  When  a  skewed  distribution  is  suspected, 


H.  E.  Boren,  Jr.,  Individual  Weapon  System  Computer  Cost  Model. 
The  RAND  Corporation,  RM-4165*PR,  July  1964. 

See  Appendix  A  for  input  list. 
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the  approach  discussed  below  should  be  used  to  describe  the  input 
uncertainty. 

In  cases  where  input  factors  are  not  derived  from  historical  data 
(e.g.,  system  requirements)  or  when  the  back-up  data  no  longer  are  avail¬ 
able,  the  cost  analyst  must  utilize  subjective  probabilities  to  dascribe 
input  uncertainty.  To  simplify  this  problem  the  following  procedure  was 
developed. 

First,  the  analyst  specifies  three  values  for  each  input  factor: 
the  lowest  possible,  most- likely,  and  highest  possible  value.  Since  the 
most-likely  value  is  the  point  estimate  normally  required,  only  two  addi¬ 
tional  estimates  are  needed.  The  cost  analyst  should  be  able  to  esti¬ 
mate,  or  at  least  approximate,  the  highest  and  lowest  possible  values 

for  each  input  parameter- -he  might,  in  fact,  welcome  the  opportunity  to 

* 

qualify  his  point  estimates  in  this  manner.  Next,  the  analyst  chooses 
from  the  nine  probability  distributions  depicted  in  Fig.  7  the  type  which 
best  describes  the  nature  of  each  factor  (or  requirement)  uncertainty. 

The  selection  must  be  based  on  whether  the  analyst  considers  the  uncer¬ 
tainty  is  skewed  left,  symmetric,  or  skewed  right  and  whether  the 
variance  (degree  of  uncertainty)  is  low,  medium,  or  high.  For  example, 
many  cost  factors  have  a  realistic  minimum  but  no  obvious  maximum 
suggesting  a  distribution  that  is  skewed  right.  On  the  other  hand,  some 
inputs,  e.g.,  system  performance  characteristics,  often  tend  to  have  un¬ 
certainties  that  are  skewed  left.  Although  the  nine  input  types  de¬ 
scribe  only  a  few  of  numerous  possible  distributions,  the  selection 
should  suffice  since  it  is  unlikely  that  an  analyst  could  accurately 
distinguish  between  more  variations  anyway. 

All  input  uncertainties  vere  assumed  to  be  beta-distributed,  with 

the  form: 

f(x)  -  K(x  -  L)a(H  -  x)P, 

where  f(x)  •  probability  of  value  x, 

L  *  lowest  possible  value, 

H  ■  highest  possible  value, 
a,  £  ■  beta  parameters. 
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Skewed  left 
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Skewed  right 


High 

variance 


<x  5 


«  =  I 3=  1.35 


<*=0.5 


«  =  3.0 


«  =  /3=  2.75 


a  =  1  .0 


Low 

variance 


«  =  4.5 


Fig.  7— Input  uncertainty  probability  distributions 
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The  mode  (m)  of  the  be^.c  function  (the  most-likely  value)  is  defined 
by  the  equation: 


a 

m  ■  — 7~r- 

or  +  0 

For  the  purpose  of  describing  input  uncertainties,  beta  distributions 
have  many  characteristics  which  would  be  expected  in  the  actual  param¬ 
eter — finite  range,  continuity,  and  unimodality.  Precedence  in  the 

use  of  beta  functions  for  this  purpose  can  be  found  in  PERT  assumptions 

* 

regarding  the  uncertainty  distribution  of  activity  durations.  For 
these  reasons,  beta  distributions  were  utilized  to  describe  the  subjec¬ 
tive  probabilities  of  inputs  to  the  cost  model  for  the  case  study. 

While  achieving  simplicity  and  ease  of  use,  one  problem  exists  in 
the  procedure  just  outlined  that  needs  mentioning.  From  the  equation 
of  the  beta  function,  we  note  that  four  parameters,  a  and  p  (implied 
by  a  selection  of  a  distribution  type)  ana  the  high- low  values,  specify 
a  unique  beta  distribution.  Any  estimate  of  thr  most- likely  input 
value  is,  therefore,  over determined.  However,  the  modal  value, 
being  more  accurate  than  either  estimated  extreme,  should  be  incorporated 
in  the  description  of  the  uncertainty  distribution.  For  this  reason, 
it  was  necessary  to  define  the  distribution  using  a,  p,  the  modal  value, 
and  range.  Because  of  the  types  of  distributions  selected  (see  Fig.  7), 
the  modal  value  of  the  simulated  inputs  will  always  be  at  the  first 
quarter,  midpoint,  or  third  quarter  of  the  range  depending  on  whether 
the  distribution  is  skewed  left,  symmetric  or  skewed  right.  Further¬ 
more,  the  calculated  high  and  low  values  will  usually  differ  slightly 
from  the  values  specified  by  the  analyst  to  estimate  the  input  range. 
However,  the  discrepancy  between  suggested  and  resultant  extreme  values 
is  not  critical. 

A  list  of  distribution  types  (coded  1  through  9)  and  suggested 
low,  modal,  and  high  values  for  some  of  the  i 95  inputs  to  the  case 
study  cost  model  are  tabulated  in  Appendix  A. 

if 

K.  R.  MacCrimaon,  An  Analytic  Study  of  the  PERT  Assumptions. 

The  FACT  Corporation,  RM-3408-PR,  December  1962. 
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MONTE  CARLO  SIMULATION  OF  SYSTEM  COST  UNCERTAINTY 

The  mechanics  of  proceeding  from  input  uncertainty  expressions  to 
estimates  of  system  cost  uncertainty  are  relatively  simple.  The  flow 
diagram  in  Fig.  8  summarizes  the  necessary  steps.  A  listing  of  the 
FORTRAN  subroutines  for  Steps  1,  3,  and  6  (called  B TABLE,  SAMPLE,  and 
HISTO,  respectively)  is  included  in  Appendix  C. 

Step  1.  In  the  first  step,  cumulative  beta  tables  for  the  nine 
functional  forms  are  generated.  By  using  128  increments  for  each  table, 
a  maximum  of  only  6  binary  search  steps  is  required  to  "look  up"  beta 
values  for  randomly  generated  decimals. 

Step  2.  Next,  the  inputs  to  the  costing  model  are  read  and  stored. 
Each  input  data  card  contains  the  low,  modal,  and  high  value  and 
functional  form  for  two  system  input  parameters. 

Step  3.  Using  a  random  number  generator,  subroutine  SAMPLE 
develops  a  Monte  Carlo  sample  value  for  each  input  parameter  based  on 
its  mode,  range  and  form.  A  different  random  number  is  used  for  each 
Monte  Carlo  simulation. 

Step  4.  After  a  complete  set  of  sample  inputs  has  been  generated, 
the  existing  cost  model  is  used  to  estimate  the  system  cost.  The 
results  are  stored  in  an  output  table. 

Step  5.  Here  the  computer  program  tests  whether  the  specified 
number  of  system  cost  estimates  have  been  calculated.  If  not,  a  new 
set  of  inputs  is  generated,  and  the  procedure  is  repeated.  When  the 
last  iteration  is  made  (1000  repetitions  were  used  in  this  study), 
the  program  proceeds  to  the  last  step. 

Step  6.  From  the  tabulation  of  estimated  system  costs,  subroutine 
HISTO  calculates  the  mean  value,  standard  deviation,  and  a  frequency 
distribution  (for  11  class  intervals).  These  parameters  provide  the 
description  of  cost  estimate  uncertainty,  thus  completing  the  objective 
of  our  study. 

CASE  I:  COST-ESTIMATING  UNCERTAINTY 

In  this  analysis,  system  cost  uncertainty  was  estimated  for 
cost -estimating  uncertainty  only;  system  requirements  were  limited  to 


Step 


Step  2 


Step  3 


Step  4 


Step  5 


Step  6 


Fig. 8— Estimating  system  cost  uncertainty 
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« 'ingle-valued  Inputs.  The  uncertainty  estimates  were  prepared  for 
major  cost  categories:  initial  investment,  annual  operating,  research 
and  development,  and  five-year  system  cost;  the  results  of  which  are 
presented  in  Figs,  9  through  12.  Included  for  comparative  purposes 
with  each  cost  distribution  is  the  point  estimate  obtained  by  limiting 
all  input  parameters  to  their  most- likely  values.  These  estimates  are 
identical  to  the  values  obtained  when  using  the  costing  model  in  its 
original  form.  Appendix  B  has  a  listing  of  the  original  computer  out¬ 
put  for  the  same  hypothetical  aircraft  system.  The  differences  between 
the  mean  values  of  the  cost  distributions  and  the  point  estimates  are 
attributable  to  the  asymmetric  form  of  the  uncertainties  ascribed  to 
the  cost  factor  inputs  and  the  extent  and  kind  of  interactions  that 
take  place  among  them  within  the  costing  model.  Although  only  major 
cost  categories  were  examined,  uncertainty  estimates  for  other  cate¬ 
gories  (e.g.,  detailed  cost  elements)  or  major  resource  requirements 
(e.g.,  personnel)  could  have  been  prepared  with  no  more  effort. 

CASE  II;  TOTAL  UNCERTAINTY 

Here,  the  effects  of  both  sources  of  uncertainty,  cost-estimating 
and  requirements,  were  analyzed.  Although  arbitrary  estimates  were 
made  to  reflect  requirement  input  uncertainty  (e.g.,  low,  modal,  and 
high  estiu«ates  of  aircraft  procurement  level  at  40,  100,  and  120  units, 

respectively,  with  a  type  4  distribution),  they  are  in  line  with  pre- 

* 

vious  studies  in  this  field.  Therefore,  the  estimate  of  total  system 
cost  uncertainty  should  be  reasonably  accurate.  As  a  further  check, 
cost -estimating  uncertainty  (Case  I)  was  found  to  be  approximately  25 

per  cent  of  the  total  uncertainty  (see  Fig.  13)  which  confirms  past 

** 

experience. 

* 

Robert  Summers,  Cost  Estimates  as  Predictors  of  Actual  Weapon 
System  Costs:  A  Study  of  Major  Hardware  Articles  (U) ,  The  RAND 
Corporation,  RM-3061-PR,  April  1962  (Secret). 

Mi' 

A.  A.  Al chian,  Reliability  of  Cost  Estimates --Some  Evidence. 

The  RAND  Corporation,  RM-481,  October  30,  1950. 


-19- 


Frequency 


Fig. 9— Initial  investment  cost  (millions  of  dollars) 


-  . 
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Frequency 


Fig.  11— Research  and  development  costs  (millions  of  dollars) 
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Fig.  12— Five-year  system  cost  (millions  of  dollars) 


© 


Fig.  13— Total  five-year  system  cost  (millions  of  dollars) 
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CONCLUSIONS 

Although  total  cost  uncertainty  can  be  estimated  using  Monte 
Carlo  techniques,  treating  cost-estimating  uncertainty  alone  seems 
preferable  in  the  context  of  most  cost  analysis  studies.  This  stems 
from  the  fact  that  the  system  planners,  who  have  control  over  require¬ 
ment  inputs,  affect  this  type  of  uncertainty.  Sensitivity  analyses 
would  probably  provide  the  planner  with  better  information  regarding 
the  nature  and  Influence  of  each  requirement  uncertainty.  However, 
the  results  of  cost- estimating  uncertainty  can  be  used  to  supplement 
sensitivity  analysis  of  requirements  uncertainties.  To  illustrate 
this,  Fig.  14  depicts  a  typical  analysis  where  cost  category  A  is 
related  to  system  requirement  X.  Confidence  limits  for  the  sensitivity 
curve  can  be  derived  from  the  cost- estimating  uncertainty  of  category 
A  costs--95  per  cent  limits  being  two  standard  deviations  (plus  and 
minus)  from  the  expected  values. 
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Cost  estimating 
uncertainty 
(95%  limits) 


System  requirement  X 

Fig.  14— Confidence  limits  for  sensitivity  analysis 
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If  the  estimated  uncertainties  for  each  cost  factor  input  are  reasonable, 
conclusions  can  be  made  from  Case  I  regarding  the  magnitude  of  cost¬ 
estimating  uncertainty  for  cost  analyses  of  chis  type.  For  example, 
the  coefficient  of  variation  (standard  deviation  divided  by  mean  value) 
tabulated  below  for  the  major  cost  categories,  indicates  the  degree  of 
uncertainty  which  might  be  expected. 

Table  2 

COST-ESTIMATING  UNCERTAINTY- -PERCENT  COEFFICIENT  OF  VARIATION 


Cost  Category 

Aircraft 

ASM 

Initial  Investment 

13 

13 

Annual  Operating 

7 

14 

Research  and  Development 

9 

13 

Total  5-year  Cost 

7 

11 
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IV.  THE  GREATER  PROBLEM;  UNCERTAINTY  IN  COST/EFFECTIVENESS  STUDIES 

Up  to  this  point,  all  discussion  regarding  the  problem  of  un¬ 
certainty  was  related  to  cost  analysis.  Now  we  shall  consider  the 
applicability  of  the  same  techniques  to  the  broader  context  of  cost/ 

effectiveness  studies.  Conceptually,  system  analysis  studies  may  take 

* 

either  of  two  forms: 

(1)  For  a  specified  level  of  effectiveness,  an  attempt 
is  made  to  determine  the  alternative  or  combination 
of  alternatives  with  the  minimum  resource  require¬ 
ment. 

(2)  For  a  given  resource  level,  an  attempt  is  made  to 
determine  the  alternative  that  will  achieve  maximum 
effectiveness. 

Assume  for  the  purpose  of  this  discussion  that  both  forms  of 
analysis  can  be  stated  in  terms  of  comparL  T  cost /effectiveness  (C/E) 
ratios  for  alternative  system  proposals.  There  are,  of  course,  inher¬ 
ent  problems  in  using  C/E  ratios  that  must  always  be  accounted  for— 
e.g. ,  the  relative  magnitudes  of  system  costs  and  utility  scales.  In 
the  first  form  of  analysis,  the  C/E  xatio  desc-ibes  "dollars  per  unit 
utility";  with  the  other  form,  the  ratio  is  "utility  per  unit  dollar." 

In  each  case,  both  utility  and  cost  iave  associated  uncertainties  — 
even  the  given  or  so-called  const  int  parameter.  Depending  upon  the 
magnitudes  and  nature  of  these  uncertainties,  their  effect  can  be 
quite  significant  to  the  decision-making  process. 

It  is  suggested  that  this  problem  can  be  treated  as  an  extension 
of  the  previous  cost  analysis  model  as  depicted  in  Fig.  15.  As  before, 
a  series  of  system  cost  estimates  is  prepared  using  Monte  Carlo  tech¬ 
niques  to  simui  ce  the  uncertainties  (cost-estimating  and/or  require¬ 
ments)  of  the  input  parameters.  In  the  same  way,  Monte  Carlo  samples 
can  be  developed  for  the  system  effectiveness  inputs  to  reflect  their 
uncertainty.  By  combining  each  system  cost  estimate  with  sample  sets 
of  effectiveness  inputs,  a  series  of  cost/effectiveness  ratios  can  be 
prepared.  From  the  sec  of  C/E  ratios,  the  uncertainty  of  this  parameter 
can  be  determined  using  the  procedures  previously  outlined. 

*G.  H.  Fisher,  Military  Systems  Coat  Analysis  (A_Summary  Lecture 
for  the  AFSC  Cost  Analysis  Course).  The  RAND  Corporation,  RM- 2975- PR, 
January  1962. 
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Source  uncertainty  Output  uncertainty 


Fig.  15 —Estimating  cost /effectiveness  uncertainty 


If  cost/effectiveness  ratios  are  prepared  for  alternative  system 
proposals  using  the  Monte  Carlo  approach,  the  impact  of  the  uncertainty 
on  the  decision-making  process  will  be  analogous  to  that  previously 
presented  graphically  in  Fig.  1. 
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WEAPON  SYSTEM  COST  MODEL  INPUTS 
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SYSTEM  REQUIREMENT  INPUTS* 


LOW 

MODE 

HIGH 

WEAPON  SYSTEM  DESIGNATOR  (STRATEGIC 
BOMBER  »  1.0,  STRATEGIC  TANKER  -  2.0, 
SM-68B  OR  SM-30  =  3.0,  OTHER 

STRATEGIC  MISSILES  -  4.0,  DEFENSE 

WING  -  5.0,  DEFENSE  GROUP  =6.0, 
TACTICAL  (ALL  BASES)  =7.0,  MATS  (ALL 
RASES)  =8.0) 

1. 

WEAPON  SYSTEM  HOST  DESIGNATOR 
(STRATEGIC  SOMBER  =1.0,  STRATEGIC 
TANKER  =  2.0,  SK-6SB  OR  SM-80  =  3.0, 
OTHER  STRATEGIC  MISSILES  (SM-65)=  4.0, 
DEFENSE  WING  =5.0,  DEFENSE  GR0UP=6.0, 
TACTICAL  (ALL  BASES)  =  7.0,  MATS  (ALL 
BASES)  =  8.0,  HOST  (NOT  A  TENANT) =9. 0) 

9. 

GROUND  OR  AIRBORNE  ALERT  DESIGNATOR 
(GA  =  1.0,  AA  =  2.0) 

2. 

ASM  PRESENCE  DESIGNATOR  (ASM'S 

PRESENT  =  1.0,  NO  ASM's  PRESENT  =  2.0) 

1. 

NUMBER  OF  YEARS  FOR  WHICH  WEAPON 

SYSTEM  IS  BEING  PRICED 

5. 

LOCATION  (2/1  =  1, ARCTIC  O/S  =  2, 

NON -ARCTIC  O/S  =3) 

1. 

NUMBER  OF  BASES  PER  SYSTEM 

1.0 

1.1 

2.0 

NUMBER  OF  STATIONS  PER  SYSTEM 

2 

3. 

6. 

NUMBER  OF  AIRCRAFT  ON  STATION 

1.0 

1.1 

2.0 

MAXIMUM  AVAILABLE  FLYING  HOURS  PER 
FLIGHT  (ENDURANCE) 

8 

10 

12 

RESERVE  FLYING  HOURS  PER  FLIGHT 

.8 

1.9 

1.6 

FLYING  HOURS  FROM  BASE  TO  STATION 

1.33 

2.33 

3.33 

MONTHLY  FLYING  HOURS  ALLOWED  PER  CREW 

60 

120 

140 

PROCUREMENT  LEVEL 

40 

100 

120 

FLYING  HOURS  PER  PERIODIC  INSPECTION 

400 

600 

800 

LENGTH  OF  PERIODIC  IN  HOURS 

24 

32 

40 

FLYING  HOURS  PER  POST-FLIGHT  INSPECTION 

125 

160 

175 

Numeric  values  describe  hypothetical  aircraft  system. 
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LENGTH  OF  POST -FLIGHT  IN  HOURS 

NUMBER  OF  SHIFTS  PER  DAY 

LENGTH  OF  SHIFT  IN  HOURS 

AIRCRAFT  POL  CONSUMPTION  RATE  IN 
POUNDS  PER  FLYING  HOUR 

CREW  RATIO 

NUMBER  OF  OFFICERS  PER  CREW  (AIRCRAFT) 
NUMBER  OF  AIRMEN  PER  CREW  (AIRCRAFT) 
WEIGHT  OF  EASH  ASM 
NUMBER  OF  ASM'S  PER  AIRCRAFT 
NUMBER  OF  PERSONNEL  REQUIRED  PER  ASM 
ASM  PROCUREMENT  LEVEL 


LOW 

8 

1 

7.0 


4 

6 

4,500 

2 

1 

80 


MODE 

10 

2 

7.75 

13,000 

0 

5 

7 

5.000 

4 

3 

IOC 


TYPE 

3 

8 

7 


8 

8 

5 
8 
8 

6 
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COST  FACTOR  INPUTS 


COMMAND  SUPPORT 
INITIAL  SPARES 

RATED  NON- CREW  TRAINING  COST,  INITIAL 
NON- RATED  OFFICER  TRAINING  COST,  INITIAL 
NON- CREW  AIRMAN  TRAINING  COST,  INITIAL 
RATED  NON- CREW  TRAINING  COST,  ANNUAL 
NON- RATED  OFFICER  TRAINING  COST,  ANNUAL 
NON- CREW  AIRMAN  TRAINING  COST,  ANNUAL 
CIVILIAN  PAY  AND  ALLOWANCES  Z/I 
CIVILIAN  PAY  AND  ALLOWANCES  O/S 
RATED  OFFICER  PAY  AND  ALLOWANCES  Z/l 
RATED  OFFICER  PAY  AND  ALLOWANCES  O/S 
NON- RATED  OFFICER  PAY  AND  ALLOWANCES  Z/I 
NON- RATED  OFFICER  PAY  AND  ALLOWANCES  O/S 
CREW  AIRMAN  PAY  AND  ALLOWANCES  Z/I 
CREW  AIRMAN  PAY  AND  ALLOWANCES  O/S 
NON- CREW  AIRMAN  PAY  AND  ALLOWANCES  Z/I 
NON- CREW  AIRMAN  PAY  AND  ALLOWANCES  O/S 
INITIAL  TRAVEL  $/MAN 
ANNUAL  TRAVEL  $/MAN  Z/I 
ANNUAL  TRAVEL  $/MAN  O/S 
ORGANIZATIONAL  EQUIPMENT  $/MAN,  INITIAL 

* 

The  low,  most-likely,  and  high  values  and  distribution  type  for 
each  cost  factor  input  are  specified  in  the  same  manner  as  the  system 
requirement  inputs. 
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ORGANIZATIONAL  EQUIPMENT  $/MAN,  ANNUAL 

INSTALLATIONS  MAINTENANCE  $/MAN,  Z/I,  TENANT 

INSTALLATIONS  MAINTENANCE  $/MAN,  Z/I,  NON -TENANT 

INSTALLATIONS  MAINTENANCE  $/MAN,  O/S,  NON- ARCTIC,  TENANT 

INSTALLATIONS  MAINTENANCE  $/MAN ,  O/S,  NON- ARCTIC,  NON- TENANT 

INSTALLATIONS  MAINTENANCE  $/MAN,  O/S  ARCTIC,  TENANT 

INSTALLATIONS  MAINTENANCE  $/MAN ,  O/S,  ARCTIC,  NON-TENANT 

INSTALLATIONS  REPLACEMENT  $/MAN ,  Z/I ,  TENANT 

INSTALLATIONS  REPLACEMENT  $/MAN,  Z/I,  NON- TENANT 

INITIAL  TRANSPORTATION  $/MAN 

ANNUAL  TRANSPORTATION  $/MAN ,  Z/I 

ANNUAL  TRANSPORTATION  $/MAN,  O/S 

INITIAL  TRANSPORTATION  PERCENT  OF  SPARES 

ANNUAL  TRANSPORTATION  PERCENT  OF  MAINTENANCE  COST,  Z/I 

ANNUAL  TRANSPORTATION  PERCENT  OF  MAINTENANCE  COST,  O/S 

CONTRACTUAL  SERVICES  $/MAN ,  MATS,  Z/I 

CONTRACTUAL  SERVICES  $/MAN,  OTHER  Z/I 

CONTRACTUAL  SERVICES  $/MAN,  MATS,  O/S 

CONTRACTUAL  SERVICES  $/MAN ,  OTHER,  O/S 

OTHER  SUPPLIES  $/MAN,  Z/I 

OTHER  SUPPLIES  $/MAN,  O/S,  ARCTIC 

OTHER  SUPPLIES  $/MAN,  O/S,  NON- ARCTIC 

ANNUAL  AMMUNITION  COST  $/MAN 

POL  STOCKS  PERCENT,  Z/I 

POL  STOCKS  PERCENT,  O/S 

INSTALLATIONS  MAINTENANCE  STOCKS  *  ERCENT 


STOCKS,  ANNUAL  SUPPLIES,  $/MAN,  Z/l 
STOCKS,  ANNUAL  SUPPLIES,  $AlAN,  O/S, 

STOCKS,  ANNUAL  SUPPLIES,  $/MAN,  O/S, 

INITIAL  FOOD  STOCKS,  $/MAN,  Z/l 
INITIAL  FOOD  STOCKS,  $ /MAN,  O/S 
INITIAL  CLOTHING  STOCKS,  $/MAN,  Z/l 
INITIAL  CLOTHING  STOCKS,  $/MAN,  O/S 
INITIAL  AMMUNITION  STOCKS,  $/MAN 
POL  CONSUMPTION  VARIANT  FACTOR 
POL  LBS.  PER  GALLON 
POL  COST  PER  GALLON  (DOLLARS) 

RATED  NON-CREW  OFFICERS  AS  PERCENTAGE  OF  CREW  OFFICERS 
OFFICERS  AS  PERCENTAGE  OF  WING  HQ.  PERSONNEL 

SQUADRON  HEADQUARTERS  PERSONNEL  AS  PERCENTAGE  OF  CREW  PERSONNEL 

OFFICERS  AS  PERCENTAGE  OF  SQUADRON  HQ.  PERSONNEL 

MAINTENANCE  PERSONNEL  PER  BASE 

MAINTENANCE  PERSONNEL  PER  AIRCRAFT 

OFFICERS  AS  PERCENTAGE  OF  MAINTENANCE  PERSONNEL 

OFFICERS  AS  PERCENTAGE  OF  SUPPORT  PERSONNEL 

STRATEGIC  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PER  BASE  (PURE 
MANNED  AIRCRAFT  BASE) 

STRATEGIC  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  PERSONNEL  (PURE  MANNED  AIRCRAFT  BASE) 

STRATEGIC  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PER  BASE  (PURE 
MISSILE  AND  MIXED  BASES) 

STRATEGIC  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  PERSONNEL  (PURE  MISSILE  AND  MIXED  BASES) 

AIR  DEFENSE  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PEP.  BASE  (WING  BASE) 


ARCTIC 

NON-ARCTIC 
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AIR  DEFENSE  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  PERSONNEL  OR  DIRECT  AND  SUPPORT  PERSONNEL  WHEN  ON  AN  AIR 
DEFENSE  BASE  (WING  BASE) 

AIR  DEFENSE  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PER  BASE  (GROUP 
BASE) 

AIR  DEFENSE  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  PERSONNEL  OR  DIRECT  AND  SUPPORT  PERSONNEL  WHEN  ON  AN  AIR  DEFENSE 
BASE  (GROUP  BASE) 

TACTICAL  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PER  BASE  (ALL  BASES) 

TACTICAL  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  PERSONNEL  (ALL  BASES) 

TRANSPORT  (MATS)  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  PER  BASE 
(ALL  BASES) 

TRANSPORT  (MATS)  WEAPON  SYSTEM  ADMINISTRATIVE  PERSONNEL  AS  PERCENTAGE 
OF  DIRECT  PERSONNEL  (ALL  BASES) 

STRATEGIC  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  BASE  (PURE  MANNED 
AIRCRAFT  BASE) 

STRATEGIC  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF  DIRECT 
AND  ADMINISTRATIVE  PERSONNEL  (PURE  MANNED  BASE) 

STRATEGIC  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  BASE  (PURE  MISSILE  AND 
MIXED  BASES) 

STRATEGIC  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF  DIRECT  AND 
ADMINISTRATIVE  PERSONNEL  (PURE  MISSILE  AND  MIXED  BASES) 

AIR  DEFENSE  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  EASE  (WING  BASE) 

AIR  DEFENSE  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF  DIRECT 
PERSONNEL  (WING  BASE) 

AIR  DEFENSE  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  BASE  (GROUP  BASE) 

AIR  DEFENSE  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF  DIRECT 
PERSONNEL  (GROUP  BASE) 

TACTICAL  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  BASE  (ALL  BASES) 

TACTICAL  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF  DIRECT  AND 
ADMINISTRATIVE  PERSONNEL  (ALL  BASES) 

TRANSPORT  (MATS)  WEAPON  SYSTEM  SUPPORT  PERSONNEL  PER  BASE  (ALL  BASES) 
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TRANSPORT  (MATS)  WEAPON  SYSTEM  SUPPORT  PERSONNEL  AS  PERCENTAGE  OF 
DIRECT  AND  ADMINISTRATIVE  PERSONNEL  (ALL  BASES) 

ADMINISTRATIVE  CIVILIANS  PER  BASE 

ADMINISTRATIVE  CIVILIANS  AS  PERCENTAGE  OF  WING  HQ.  PERSONNEL 
ASM  CIVILIANS  AS  A  PERCENTAGE  OF  ASM  MILITARY  PERSONNEL 
MAINTENANCE  CIVILIANS  AS  PERCENTAGE  OF  MILITARY  MAINTENANCE  PERSONNEL 
SUPPORT  CIVILIANS  AS  A  PERCENTAGE  OF  MILITARY  SUPPORT  PERSONNEL 
COST  OF  AIRCRAFT  NUMBER  1  (IN  MILLIONS  OF  DOLLARS) 

CUMULATIVE  AVERAGE  COST  CURVE  SLOPE  (0.  TO  1.) 

SERVICING,  PREFLIGHT  AND  THROUGH -FLIGHT,  AND  OFF -AND -ON  LOADING  OF 
MISSILES 

EXTRA  DOWN-TIME  PER  FLIGHT  IN  HOURS 
UNSCHEDULED  MAINTENANCE  PERCENT  (SORTIES) 

UNSCHEDULED  MAINTENANCE  PERCENT  (FLYING  HOURS) 

DEPOT  MAINTENANCE  COST  PER  FLYING  HOUR 

BASE  MATERIALS  COST  PER  FLYING  HOUR 

DEPOT  MAINTENANCE  COST  PER  SORTIE 

BASE  MATERIALS  CO$T  PER  SORTIE 

ATTRITION  RATE  PER  SORTIE 

ATTRITION  RATE  PER  FLYING  HOUR 

INITIAL  TRAINING  COST  PER  CREW  (AIRCRAFT) 

ANNUAL  TRAINING  COST  PER  CREW  (AIRCRAFT) 

FACILITIES  COST  PER  AIRCRAFT 
FACILITIES  COST  PER  MAN  (AIRCRAFT) 

FACILITIES  COST  PER  BASE  (AIRCRAFT) 

FACILITIES  PERCENT  FOR  UTILITIES  (AIRCRAFT) 

OVERSEAS  FACILITIES  COST  RATIO  (AIRCRAFT) 
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AIRBORNE  ELECTRONICS  EQUIPMENT  COST  PER  AIRCRAFT  (IN  MILLIONS  OF 
DOLLARS) 

AIRCRAFT  RDT&E  (IN  MILLIONS  OF  DOLLARS) 

AGE  COST  FACTOR  (AIRCRAFT) 

AGE  SPARES  COST  FACTOR  (AIRCRAFT) 

AGE  MAINTENANCE  COST  FACTOR  (AIRCRAFT) 

AEE  SPARES  COST  FACTOR  (AIRCRAFT) 

AEE  MAINTENANCE  COST  FACTOR  (AIRCRAFT) 

COST  OF  ASM  NUMBER  1  (IN  MILLIONS  OF  DOLLARS) 

SLOPE  OF  ASM  CUMULATIVE  AVERAGE  COST  CURVE  (0.  TO  1.) 

ASM  INSTALLATIONS  COST  PER  MILITARY  MAN 
ASM  INSTALLATIONS  COST  PER  ASM 
ASM  INSTALLATIONS  COST  PER  BASE 

AIRBORNE  ELECTRONICS  EQUIPMENT  COST  PER  ASM  (IN  MILLIONS  OF  DOLLARS) 
ASM  RDT&E  (IN  MILLIONS  OF  DOLLARS) 

ASM  PIPELINE  FACTOR 
ASM  OFFICER  REQUIREMENT  FACTOR 
ASM  AIRMAN  REQUIREMENT  FACTOR 
ASM  OFFICER  TURNOVER  RATE 
ASM  AIRMAN  TURNOVER  RATE 
ASM  SPARES  COST  FACTOR 
AGE  COST  FACTOR  (ASM) 

AGE  SPARES  COST  FACTOR  (ASM) 

AEE  SPARES  COST  FACTOR  (ASM) 

ORGANIZATIONAL  EQUIPMENT  COST  PER  MAN  (ASM) 

INITIAL  INSTALLATIONS  MAINTENANCE  MATERIALS  COST  FACTOR  (ASM) 

INITIAL  TRANSPORTATION  COST  FACTOR  (ASM) 


-38- 


INITXAL  TRAINING  COST  PER  OFFICER  (ASM) 

INITIAL  TRAINING  COST  PER  AIRMAN  (ASM) 

INITIAL  TRAVEL  COST  PER  OFFICER 
INITIAL  TRAVEL  COST  PER  AIRMAN  (ASM) 

INITIAL  FOOD  COST  PER  MAN  (ASM) 

INITIAL  CLOTHING  COST  PER  MAN  (ASM) 

INITIAL  COST  OF  MISCELLANEOUS  SUPPLIES  PER  MAN  (ASM) 

INITIAL  AMMUNITION  COST  PER  MAN  (ASM) 

ASM  MAINTENANCE  COST  FACTOR 
ASM  REPLACEMENT  COST  FACTOR 
ASM  CONSUMPTION  COST  FACTOR 

AGE  MAINTENANCE  COST  AND  REPLACEMENT  COST  FACTOR  (ASM) 

AEE  MAINTENANCE  COST  FACTOR  (ASM) 

ORGANIZATIONAL  EQUIPMENT  MAINTENANCE  AND  REPLACEMENT  COST  PER  MAN  (ASM) 
ASM  INSTALLATIONS  MAINTENANCE  COST  FACTOR 
ASM  INSTALLATIONS  REPLACEMENT  COST  FACTOR 
ANNUAL  TRANSPORTATION  COST  PER  MAN  (ASM) 

PAY  AND  ALLOWANCE  COST  PER  OFFICER  (ASM) 

PAY  AND  ALLOWANCE  COST  PER  AIRMAN  (ASM) 

ANNUAL  TRAINING  COST  PER  OFFICER  (ASM) 

ANNUAL  TRAINING  COST  PER  AIRMAN  (ASM) 

ANNUAL  TRAVEL  COST  PER  OFFICER  (ASM) 

ANNUAL  TRAVEL  COST  PER  AIRMAN  (ASM) 

ANNUAL  CONTRACTUAL  SERVICES  AND  OTHER  COST  PER  MAN  (ASM) 

ANNUAL  AMMUNITION  COST  PER  MAN  (ASM) 
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Appendix  B 

WEAPON  SYSTEM  COST  MODEL  OUTPUTS 
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AIRBCRNE  ALERT  BASIC  CASE 


STRATEGIC  BOMBER  WEAPON 


SYSTEM  —  HOST 


AIRBORNE  ALERT  CASE  NUMBER  1001. 


INITIAL  INVESTMENT  COSTS 


AIRCRAFT 

MISSILE 

TOTAL 

TOTAL  PROCUREMENT 

359.0 

44.9 

404.0 

PRIMARY  MISSION  EQUIPMENT 

299 .2 

39.  1 

338.3 

PRIMARY  MISSION  EQUIPMENT  SPARES 

59.3 

5.9 

65.7 

TOTAL  AGE  ♦  AEE 

2C8.4 

19.3 

227.7 

AEROSPACE  GROUND  EQUIP. 

59.8 

7.8 

6  7.7 

AEROSPACE  GROUND  EQUIP.  SPARES 

6.0 

2.0 

7.9 

AIRBORNE  ELECTRONICS  EQUIP. 

105.6 

7.0 

112.6 

AIRBORNE  ELECTRONICS  EQUIP.  SPARES 

37.0 

2.5 

39,4 

TOTAL  FACI  %ES 

21.9 

1.7 

23.7 

TOTAL  TRAINING  AND  TRAVEL 

15.2 

1.1 

16.3 

TRAINING 

14.0 

I.  1 

15.1 

TRAVEL 

1.2 

0.0 

1.3 

TOTAL  OTHER  INVESTMENT 

7.6 

1.4 

9.0 

INITIAL  STOCKS 

2.0 

0.  1 

2.2 

ORGANIZATIONAL  EQUIPMENT 

4.5 

0.3 

4.8 

TRANSPORTATION 

1.1 

1.0 

2.0 

TOTAL  INITIAL  INVESTMENT 

612.2 

60.5 

680.7 
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ANNUAL  OPERATING  COSTS 


AIRCRAFT 

MISSILE 

T3TA 

TOTAL  OPERATIONS 

35.3 

9  oO 

44.3 

MAINTENANCE 

14. q 

5.9 

20.8 

POL 

11.6 

11.6 

ATTRITION 

8.8 

8.8 

REPLACEMENT 

1.2 

1.2 

CONSUMPT  ION 

2.0 

2.0 

TOTAL  AGE  ANO  AEE  MAINTENANCE 

32.4 

3.7 

36.1 

AEROSPACE  GROUND  EQUIP.  MAINT. 

6.0 

2.0 

7.9 

AIRBORNE  ELECTRONICS  EQUIP.  MAINT. 

26.4 

1.8 

28.2 

TOTAL  FACILITIES  MAINT.  ♦  REPLACE. 

2.9 

0.2 

3.0 

FACILITY  MAINTENANCE 

0.6 

0.1 

0.7 

FACILITY  REPLACEMENT 

2.3 

0.1 

2.3 

TOTAL  PERSONNEL 

18.0 

1.1 

19.1 

PAY  AND  ALLOWANCES 

14.6 

0.9 

15.5 

TRAINING 

2.6 

0.2 

2.8 

TRAVEL 

O.fl 

0.0 

0.8 

total  other  operating 

3.1 

0.1 

3.2 

REPLACEMENT  OF  ORGANIZATIONAL  EQUIP. 

0.5 

0.0 

0.5 

TRANSPORTAT ion 

0.8 

0.0 

0.9 

MISCELLANEOUS 

1.8 

0.  1 

1.9 

TOTAL  ANNUAL  OPERATING 

91.7 

14.1 

IC5.8 

RESEARCH  ANO  DEVELOPMENT 

450.0 

800.0 

1250.0 

TOTAL  5-YEAR  SYSTEM  COST 

1520.9 

9  38.8 

2459.7 

MISCELLANEOUS  DATA 


CASE  NUMBER  1001.0 
NUMBER  OF  BASES  PER  SYSTEM  1.0 
NUMBER  OF  STATIONS  PER  SYSTEM  3.0 
ENDURANCE  HOURS  10. 0 
RESERVE  FLYING  HOURS  PER  FLIGHT  1.0 
FLYING  HOURS  FROM  BASE  TO  STATION  2.3 
OPERATIONAL  AIRCRAFT  PER  SYSTEM  16.0 
COST  OF  AIRCRAFT  NUMBER  l  17.0 
CUMULATIVE  COST  CURVE  SLOPE  (AIRCRAFT)  1.0 
PROCUREMENT  LEVEL  FOR  AIRCRAFT  100.0 
MONTHLY  FLYING  HOURS  PER  CREW  120.0 
HOURS  IN  MAINT.  ANO  SERV.  PER  MISSION  7.3 
LAPSEO  HOURS  PER  MISSION  iNCL.  MAINT.  22.0 
EFFECTIVE  UTILIZATION  RATE  (PERCENT)  18.7 
EFFECTIVE  TIME  ON  STATION  (HOURS)  4.3 
OPERATIONAL  AIRCRAFT  PER  BASE  16.0 
TOTAL  PERSONNEL  PER  BASE  3565.0 
NUMBER  OF  SHIFTS  PER  DAY  2.0 

NUMBER  OF  MISSILES  PER  AIRCRAFT  4.0 
WEIGHT  OF  EACH  MISSILE  5000.0 
COST  OF  MISSILE  NUMBER  l  0.6 
CUMULATIVE  COST  CURVE  SLOPE  (MISSILE)  1.0 
PROCUREMENT  LEVEL  FOR  MISSILES  100. 0 
OPERATIONAL  MISSILES  REQ.  PER  SYSTEM  64.0 


PERSONNEL  REQUIREMENTS 


OFFICERS 

AIRMEN 

M I L 1 TARY 

CIVILIANS 

TOTAL 

ADMI NISTRATION 

68. 

264. 

353. 

10. 

363. 

SQUADRON  HQ. 

11. 

34. 

45. 

45. 

FLIGHT  CREW 

18  7. 

261. 

448. 

448. 

M  I  SS  1 1.  E 

32. 

180. 

211. 

0. 

211. 

MAINTENANCE 

20. 

638. 

658. 

0. 

650. 

SUPPORT 

113. 

1502. 

1615. 

226. 

1841. 

TOTAL 

450. 

2878. 

3329. 

236. 

3565. 

RATEO  NON-CREW 


19 
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Appendix  C 

FORTRAN  SUBROUTINES  FOR  ESTIMATING  UNCERTAINTY 
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1  SUBROUTINE  BTA8LE 

COMMON  /BTAB/  NTABLE*  CUMB(9*128)»  XTABLE(128) 

GENERATES  CUMULATIVE  BETA  TABLES  FOR  NINE  BETA  EQUATIONS 

DO  10  M  =  1*9 
NTABLE  *  M 
DELTA  =  0.0078125 
A  =  0.0 
B  =  DELTA 
DO  10  J  *  1.128 

PKLEQ — A  LIBRARY  ROUTINE—  IS  USED  TO  INTEGRATE  BETA  EQUATIONS 
CUMB(M.J)  =  PKLEQ(A.B) 

XTABLE(J)  =  B 
B  =  B  +  DELTA 
10  CONTINUE 
RETURN 
END 
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1  FUNCTION  SSSSS(X) 

COMMON  /BTAB/  NTABLE.  CUMB(9*128).  XTABLE (128) 

THIS  SUBROUTINE— USED  BY  PKLEQ —  DEFINES  BETA  EQUATION  PARAMETERS 

!  F  INTABLE  .EO.  1 )  GO  TO  1 

IF  (NTABLE  • EQ.  2)  GO  TO  2 

IF  (NTABLE  .EQ*.  3)  GO  TO  3 

IF  (NTABLE  .EQ.  4)  GO  TO  4 

IF  (NTABLE  .EQ.  5)  GO  TO  5 

IF  (NTABLE  *EQ.  6)  GO  TO  6 

IF  (NTABLE  .EQ.  7)  GO  TO  7 

IF  (NTABLE  .EQ.  8)  GO  TO  8 

IF  (NTABLE  . EQ.  9)  GO  TO  9 


1 

ALPHA 

=  1.5 

BETA 

=  0.5 

CONST 

=  5.1 

GO  TO 

10 

2 

ALPHA 

=  1.35 

BETA 

=  1.35 

CONST 

=10.66 

GO  TO 

10 

3 

ALPHA 

=  0.5 

BETA 

=  1.5 

CONST 

=  5.1 

GO  TO 

10 

4 

ALPHA 

=  3.0 

BETA 

=  1.0 

CONST 

=  20. 0 

GO  TO 

10 

5 

ALPHA 

=  2.75 

BETA 

=  2.75 

CONST 

=  95.5 

GO  TO 

10 

6 

ALPHA 

=  1.0 

BETA 

=  3.0 

CONST 

*  20.0 

GO  TO 

10 

7 

alpha 

*  4.5 

BETA  *  1.5 
CONST  *  72.5 
GO  TO  10 

8  ALPHA  =  4.0 
BETA  =  4.0 
CONST  *  630. 

GO  TO  10 

9  ALPHA  =  1.5 
BETA  =  4.5 
CONST  »  72.5 

10  SSSSS  *  (CONST)  *  (X**ALPHA)  *  ((1.0  -  X)**BETA) 
RETURN 
FND 
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SUBROUTINE  SAMPLE 

GENERATES  A  MONTE  CARLO  VALUE  FOR  EACH  INPUT  PARAMETER 


COMMON  /NUM/  NUM1 »  NUM2»  NUM3»  ITER*  NI 
COMMON  /RT AS/  NTABLF*  CUMB«9»128),  XTABLE(1>8) 


COMMON  /DATA/  IDATAI420)*  GL0WU20) 


C 

C 

C 

C 

C 

C 

c 

c 

< 

c 

c 

c 

c 

c 

c 

( 

c 

c 

c 

c 

c 

c 

( 

c 

c 

c 

c 

c 


I  TYPE ( 420 )  ♦  FLOW ( 420  )  »  FMODF(420)» 
OUT ( 1000 9 13) 

FHIGHI420] 

,  NTYPF ( 420 ) , 

COMMON 

AA. 

AR  , 

AC, 

AD. 

AF, 

AF, 

AC, 

AH, 

A  I  , 

AJ, 

AK  , 

AL  , 

AM. 

AN. 

AO. 

AP. 

AQ. 

AR, 

AS. 

AT, 

AU» 

AV  , 

AW, 

AX  , 

AY, 

AZ. 

BA, 

BB. 

BC, 

5D, 

BE, 

BF, 

BG, 

BH  , 

B  I  , 

BJ, 

BK, 

BL, 

BM* 

BN. 

BO, 

BP. 

BQ, 

BR, 

RS, 

BT, 

BU, 

BV, 

B  W , 

BX, 

BY, 

BZ. 

CA, 

CB, 

cc. 

CD. 

OB, 

OC, 

OD, 

RC, 

RD, 

RG, 

RH, 

RJ, 

RK, 

RL, 

rm» 

R0» 

AS  1  , 

AS?  » 

AS3  , 

AS4  , 

ADI , 

AO 2  , 

AD3  f 

AD4, 

ATI  , 

AT?. 

AMI  » 

AM2  ♦ 

SSI , 

SS2  » 

SS3  » 

SS4  ♦ 

SD3  , 

SD2  » 

SD3, 

SD4, 

ST  1  , 

ST2  » 

SMI  . 

SM2  ♦ 

Cl  . 

C2» 

C  3  , 

C4, 

C  5  ♦ 

AGi, 

AG2  ♦ 

AG3, 

AF  1  , 

AE2, 

HA, 

HB. 

HC» 

HD. 

HE. 

HF, 

HG. 

HH, 

HI  , 

HJ, 

HM, 

HN, 

HO, 

HP, 

HO. 

HR, 

HS, 

HT  , 

HU. 

H  V  » 

QA, 

OB, 

QC, 

QD, 

QE, 

QG, 

QH  ,Q  I 

COMMON 

Q  J , 

OK  9 

QL. 

QM, 

ON  » 

QO, 

OP, 

QQ, 

OR, 

RUN, 

T  W  S  , 

TWH, 

GOA. 

ASM, 

YOP  , 

DB, 

EA, 

ER, 

EC, 

ED, 

EE, 

EF, 

FA, 

FB, 

FC, 

GA  . 

GB, 

GC, 

GD, 

GE. 

GF, 

GG, 

GG1  , 

GG2  , 

GH , 

G  I  , 

GK, 

GL, 

GM. 

OA, 

PA, 

PB, 

PC, 

RA  » 

RB, 

SA, 

SB, 

TA, 

TB, 

TC, 

TD, 

TE. 

EEA , 

RDA  , 

WA, 

WB» 

WC » 

W  D  ♦ 

WE , 

WF, 

WG , 

WH  , 

WI  , 

EEM, 

RDM. 

A2  » 

A3, 

A4  ♦ 

A, 

B, 

C, 

D, 

E, 

F, 

G 1  , 

G, 

H, 

H2. 

I  . 

0, 

P. 

Q 1 » 

Q, 

02  , 

R, 

S, 

T, 

U» 

VI, 

V,  W 

COMMON 

X  , 

PMA, 

PMO, 

PMT  » 

XXX, 

ZA, 

ZB, 

ZC, 

ZCA, 

ZD, 

ZDA  , 

ZE, 

ZF, 

ZFA  , 

ZG, 

ZGA , 

ZH, 

ZHA, 

ZI  » 

?  I A , 

ZJ, 

ZL, 

ZT, 

OF  A . 

AMA, 

OFB  ♦ 

AMB, 

CFC  » 

AMC, 

OFD, 

AMD, 

CVA, 

CVR, 

cvc, 

CVD, 

TOA, 

TOB, 

TOC, 

TOD, 

XA, 

XB  , 

xc, 

XD» 

XE, 

XF, 

XG, 

XH, 

XI  , 

XJ, 

XK, 

XL, 

XM. 

XN  , 

X0» 

XP. 

XQ, 

X  R  ♦ 

YA  . 

YR, 

YC  , 

YD, 

YE, 

YF, 

YG, 

YH, 

Y  I  » 

YJ, 

YK, 

YL  » 

YM, 

YN  » 

Y01  , 

YO?  , 

YP, 

YQ, 

AGE, 

AGS, 

AGM, 

AEE, 

AES, 

AEM, 

TAE, 

TCS  ♦ 

TMC, 

TSC, 

TTC  ♦ 

TTT, 

Pi  , 

P2, 

D3  »P4 

COMMON 

P5» 

P  6* 

P7* 

?8  » 

P  9  » 

PlO, 

Pll  , 

Pi 2  ♦ 

Pi  3  , 

Pi  4  ♦ 

P 1  5  * 

Pl6» 

P17. 

Pi 8  . 

P  1 9  » 

P20, 

P2I  * 

P22» 

P23  » 

P  2  A  . 

P2S  , 

P26, 

P2  7, 

P28, 

P?9  , 

P30  s 

P31  . 

P  32  » 

P  3  3  » 

P34, 

P35, 

P 36  » 

P37, 

P38> 

P39, 

P40  , 

P  4 1  , 

P42  , 

P43  * 

PA  4, 

P45  » 

P46 » 

P47, 

P4  8, 

P4°  » 

P60, 

P51  , 

P5  2  * 

P53  , 

P 54 , 

P55, 

P56, 

P57, 

Pf>8  » 

P59, 

P60, 

P61  , 

P62  , 

P63, 

P64, 

P6  5  » 

P66 , 

P67, 

P68, 

P69, 

P70. 

P  7 1  , 

P  72, 

P73  i 

P  7  4  » 

P75  * 

P  76  • 

P77  , 

P78, 

P  79 , 

P80, 

P81  , 

P82* 

P83  , 

PGA, 

P85. 

P86  ♦ 

P87, 

PfiB. 

P89, 

P90  ♦ 

P9  1  , 

P92, 

P93  , 

P94  , 

P93  »  P96, 
P1C0.P109. 

P9  7  »  P9  8, 

P99.P10C.P101 » PI  02 » 
=>112,  T  I  TLE ( 1 2 ) 

■>103,P104,P105,P1G&, 

P 1  07  , 

GMODEU20)  ,  GH  I GH  (  420  )  ♦ 


DIMENSION  FDATA(l) 
EQUIVALENCE  ( AA *FDATA ( 1 ) ) 


DO 

99  Ns  1,1 96 

IF 

(NTYPE(N) 

•  EQ. 

1 ) 

GC 

TO 

1 

IF 

(NTYPE(N) 

.FQ, 

2  ) 

GO 

TO 

2 

IE 

(NTYPF(N) 

•  FQ. 

3  ) 

GO 

TO 

3 

IF 

(NTYPE(N) 

•*  0  • 

4  ) 

GO 

TO 

4 

IE 

( NTYPF { N ) 

«  EQ* 

5) 

GO 

TO 

5 

IF 

(NTYPE(N) 

•  FO* 

6  ) 

GO 

TO 

fc 

IF 

(NTYPE(N) 

•  FO. 

7) 

GO 

TO 

7 

IF 

(NTYPF ( N) 

.FQ. 

8) 

GO 

TO 

8 

I  p 

(NTYPF ( N) 

*c0. 

9) 

CO 

TO 

9 
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SINGLE  VALUED  INPUT 
FDATA(N)  =  FMOOE(N) 

GO  TO  99 

DISTRIBUTION  SKEWED  LEFT 

1  SMCDE  =0.75 

y.  =  l 

GO  TO  10 

4  SMOOE  =0.75 
M  =  A 

GO  TO  10 

7  SMODE  =  0.75 
M  ■  7 

GO  TO  10 

DISTRIBUTION  SYMETR IC 

2  SMODE  =  0.50 
M  =  2 

GO  TO  10 

5  SMODE  =  0.50 
M  =  5 

GO  TO  i0 

8  SMODE  *  0.50 
M  =  8 

GO  TO  10 

DISTRIBUTION  SKEWED  RIGHT 

3  SMODE  =  0.25 
M  =  3 

GO  TO  10 

6  SMODE  =0.25 
M  =  6 

GO  TO  10 

9  SMODE  =  0.25 
M  =  9 

10  CALL  RANDOM! R) 

BINARY  SEARCH  FOR  CUM  BETA 
J  =  64 

DO  13  K  =  1*6 
L  =  6  -  K 

IF  (CUMB<M»J)  .LT.  R)  GO  TO  11 
IF  (CUM6CM.J)  .GT.  R)  GO  TO  12 
GO  TO  14 

11  J  =  J  +  2**L 
GO  TO  13 

12  J  =  J  -  2**L 

13  CONTINUE 

14  SAMPLX  *  XTABLF(J) 

FDATA(N)  =  FMODE(N)  +  (FHIGHINl  -  FLOV'(N)  >  *  (SAMPLX  -  SMODE) 
99  CONTINUE 
100  return 
END 
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SUBROUT INF  H I S T 0 

COMMON  /NUM/  NUM)  .  NUM2.  MUM?*  I  T  E  0  »  N I 
COMMON  /DATA/  1PATA(420).  GLOW(420).  GMODE(420>. 
C  I  TYPE ( 420 ) »  FLOW (  420  ) *  FMCDE(420).  FHIGH(420). 
C  OUT (1000.13) 

DIMFNSION  XVAL (25*13) »  NFREG(25.13) 


GH I GH ( 420 ) ♦ 
NTYPE ( 420 ) ♦ 


CALCULATES  MEAN*  STANDARD  DEVIATION.  AND  PREPARES  HISTOGRAM 


DO  99  J  =  1*13 

CALCULATE  INTERVAL  RANGE  (RINT)  FOR  N!  INTERVALS 
XMIN  *  OUT ( 1 »  J ) 

XMAX  =  OUT  (.  1  »  J  ) 

DO  1  K*1 *  I  TER 

IF  ( OUT {  K  »  J )  .LT.  XMIN)  XMIN  a  OUT(K.J) 

IF  (OUT(K.J)  .GT.  XMAX)  XMAX  *  OUT(K.J) 

1  CONTINUE 

RINT  =  (XMAX  -  XMIN)  /  FLOAT ( NI ) 

CALCULATE  MEAN  VALUE  (XVAL)  FOR  EACH  INTERVAL 
XVAL  < 1 ♦ J )  =  XMIN  +  RINT/2. 

DO  10  N  =  2  » N I 

10  XVAL(N.J)  =  XVAL(N-l.J)  ♦  RINT 

DETERMINE  DATA  FREQUENCY  FOR  EACH  INTERVAL 
DO  20  N  =  1  *  N I 

20  NFREQ(N.J)  *  0 
DO  22  K*  1 .  I  TER 
DO  21  N*  1  *  N I 

XL  I M  a  XVAL(N.J)  +  RINT/2. 

IF  ( XL IM  .GE.  OUT(K.J)J  GO  TO  22 

21  CONTINUE 
N  =  NI 

22  NFREQ(N.J)  =  NFREO(N.J)  +  1 
CALCULATE  MEAN  VALUE  ( XMEAN ) 

SUMX  *  0. 

DO  30  K  =  1  *  I  TER 
30  SUMX  =  SUMX  +  OUT  <  K  *  J  ) 

XMEAN  =  SUMX  /  FLOAT ( I  TER ) 

CALCULATE  STANDARD  DEVIATION  (XSDEV) 

SUMSQ  =  0. 

DO  40  K  *  l.ITER 

40  SUMSQ  =  SUMSQ  +  (OUT(K.J)  -  XMEAN)**2 
XVAR  *  SUMSQ  /  (FLOAT ( ITER)  -  1.0) 

XSDEV  a  SORT (XVAR) 

PRINT  OUTPUT 

PRINT  50.  (XMIN.  XMAX.  XMEAN.  XSDEV) 

50  FORMAT  ( 16H1M IN IMUM  VALUE  s*  F10.1  /  1 6H0MAX I  MUM  VALUE  a,  FlO.l  / 

C  1 6H0  MEAN  VALUE  =.  Fl^.l  /  16H0S TANDARD  DEV.  et  FlO.l  //) 

DO  51  N  a  l.N! 

51  PRINT  52.  (XVAL(N.J).  NFREQ(N.J)) 

52  FORMAT  ( 1 4X .F 1 0 • 1 • I  10 ) 

99  CONTINUE 

100  RETURN 
END 
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